|
Author |
Thread Statistics | Show CCP posts - 0 post(s) |

Scrapyard Bob
EVE University Ivy League
0
|
Posted - 2011.09.22 02:17:00 -
[1] - Quote
The API is throwing errors all day again.
LOGSQL Insert Failed: insert into adodb_logsql (created,sql0,sql1,params,tracer,timer) values( NOW(),?,?,?,?,?) No database selected
Warning: Cannot modify header information - headers already sent by (output started at /home/admin/domains/coronum.nl/public_html/dev/evemarketeer.com/core/lib/adodb5/adodb.inc.php:482) in /home/admin/domains/coronum.nl/public_html/dev/evemarketeer.com/mod/api.php on line 151 |

Scrapyard Bob
EVE University Ivy League
0
|
Posted - 2011.09.22 15:30:00 -
[2] - Quote
That was indeed it, my ImportXML() was still pulling from "evemarketeer.com" instead of "www.evemarketeer.com". |

Scrapyard Bob
EVE University Ivy League
0
|
Posted - 2011.09.29 01:51:00 -
[3] - Quote
Quote:LOGSQL Insert Failed: insert into adodb_logsql (created,sql0,sql1,params,tracer,timer) values( NOW(),?,?,?,?,?) Table './admin_icras/adodb_logsql' is marked as crashed and last (automatic?) repair failed
http://www.evemarketeer.com/statistics/uploads/24
This is showing up at the top of a few pages as well as in the upload tool. |

Scrapyard Bob
EVE University Ivy League
0
|
Posted - 2011.10.01 02:29:00 -
[4] - Quote
Callean Drevus wrote: Also, I might need to start processing EMD orders in the same way I now process EMK orders, since that seems to be the fastest way, and I now get an immense backlog of EMD orders :P or I could just work on making order processing faster.
As in, making the upload tool send them directly to EMD instead of passing them through the EMK site? That would be good, at least EMD would get its updates even if EMK is having trouble (or vice-versa).
(Tonight, in order to update market data, I'm using the EMD market-scanner page, because the EMK page button to start scanning is not showing up.) |

Scrapyard Bob
EVE University Ivy League
0
|
Posted - 2011.10.04 15:17:00 -
[5] - Quote
The scanner page is definitely still having issues, if it does come up, it eventually ends up with a gateway timeout error - which means my noble attempt to leave an alt logged in overnight comes to naught.
On the feature request side:
http://www.evemarketeer.com/statistics/uploads - It would be better if this page was sorted by region name in alphabetical order, instead of by RegionID
http://www.evemarketeer.com/statistics/regions - same request, please sort by region name
http://www.evemarketeer.com/item/itemprice/Oxygen_Isotopes - On the regional prices tab, it would be useful if there was an indicator as to how current the data is for each region. Maybe presented as "The Forge (3 hrs)" or "Domain (2 days)" - The orders tab, doesn't let me look at other regions |

Scrapyard Bob
EVE University Ivy League
0
|
Posted - 2011.10.04 15:24:00 -
[6] - Quote
One other question - does the EMK uploader send data to EVE Central as well?
(The fact that you send data to EMD in addition to EMK is a key reason I use your uploader.) |

Scrapyard Bob
EVE University Ivy League
37
|
Posted - 2011.10.20 18:05:00 -
[7] - Quote
I see no issue with it being in the bottom bar, or in tiny text at the bottom of the screen (I'd prefer it down there, out of the way rather then in a left/right column which would shrink screen width). |

Scrapyard Bob
EVE University Ivy League
62
|
Posted - 2011.10.23 06:32:00 -
[8] - Quote
Once the site comes back up I have a few questions...
- On the manufacturing information, what assumptions are you making with regards to T1 manufacturing of items? Are you assuming a reasonable ME level and Production Efficiency V?
- Have you considered trying to estimate T2 invention costs (such as what EVETools does)?
|

Scrapyard Bob
EVE University Ivy League
351
|
Posted - 2011.11.14 21:06:00 -
[9] - Quote
On the market scanner page - after a while (an hour or two), it stops giving commands to the in-game market window. Not exactly sure why, (maybe you're going up against some sort of throttle and you need to back off to 3.2 or 3.5 seconds).
The page is still running, it's just not looking up items on the market. |

Scrapyard Bob
EVE University Ivy League
351
|
Posted - 2011.11.15 13:46:00 -
[10] - Quote
Callean Drevus wrote: @Scrapyard Bob: Does it stop looking up items (say, the market window does not constantly pop up anymore), or does it stop sending data? Since after a few hours, the entire market would be scanned, and EVE doesn't generate new cachefiles if everything is cached already (even if the uploader deleted the files).
If the second is true, was it always doing this? Or is it a new problem?
The market window stops popping up.
|
|

Scrapyard Bob
EVE University Ivy League
370
|
Posted - 2011.11.19 00:16:00 -
[11] - Quote
If I make an API query call with a wrong typeID like:
http://www.evemarketeer.com/api/info/37_40_36_0_11399_38_35_34_39/xml/10000030/sell_lowest5 or http://www.evemarketeer.com/api/info/37_40_36__11399_38_35_34_39/xml/10000030/sell_lowest5
I should still get back 9 rows. Instead, I only get back 8 rows in the above example. Ideally, that 4th row should simply have a zero in the sell_lowest5 and the datetime should be a date from a year ago (or the start of the epoch?).
|

Scrapyard Bob
EVE University Ivy League
374
|
Posted - 2011.11.20 13:28:00 -
[12] - Quote
Callean Drevus wrote:In any case, will be fixed (the outdated information). And will be taken into consideration (the API queries), ideally you just wouldn't call the API with invalid information 

I live to break things. In this particular case, I was setting up a sheet to track T1 ship construction prices and estimated margins. Since I don't have typeIDs for the new BCs yet, I had to just either leave those cells blank or put zeros in.
Zeros as a "invalid" return value are good, because you can easily exclude them with a CountIf() in most spreadsheets. And they don't screw up any Sum() functions. So if I pull 3 regions, I just do the calculation for the average price column as:
AvgPrice = Sum(A4:C4) / CountIf(A4:C4,">0")
|

Scrapyard Bob
EVE University Ivy League
384
|
Posted - 2011.11.23 05:56:00 -
[13] - Quote
Tried using the new uploader again tonight, went back to EMD's. Hopefully you can pull the data from EMD 
The issue that I have with the EMK uploader is that it's not very responsive to UI input when it's waiting for communication to the various websites to complete. I'm not sure what the fix there is, other then to split it into multiple threads, each thread uploading to a different site so that a single site being slow about processing doesn't impact the upload rates of the other sites. |

Scrapyard Bob
EVE University Ivy League
400
|
Posted - 2011.11.26 06:29:00 -
[14] - Quote
Got one tonight while looking up an item:
http://www.evemarketeer.com/item/itemprice/Memory_Augmentation_-_Improved
Fatal error: Uncaught exception 'Dwoo_Exception' with message 'Dwoo->get/Dwoo->output's first argument must be a Dwoo_ITemplate (i.e. Dwoo_Template_File) or a valid path to a template file' in /var/www/www.evemarketeer.com/core/lib/dwoo/Dwoo.php:314 Stack trace: #0 /var/www/www.evemarketeer.com/core/mod/template.php(33): Dwoo->get('core/tpl/item/i...', Array) #1 /var/www/www.evemarketeer.com/core/mod/page.php(33): template_parse('item/itemprice....', Object(Request)) #2 /var/www/www.evemarketeer.com/core/main.php(69): page->renderBody(Object(Request)) #3 /var/www/www.evemarketeer.com/index.php(8): include('/var/www/www.ev...') #4 {main} thrown in /var/www/www.evemarketeer.com/core/lib/dwoo/Dwoo.php on line 314 |

Scrapyard Bob
EVE University Ivy League
400
|
Posted - 2011.11.26 06:30:00 -
[15] - Quote
Domi Etymology wrote: I've been noticing this myself. It didn't actually click that it the headaches I've been having with the uploader were occuring while it was waiting for communication to the different websites. Over the last couple of days, I've turned off uploading to eve-central, which helped a ton. Also, whatever you did with your server upgrade increased responsiveness a ton :)
Currently, if I leave 3 clients uploading data simultaneously for 15 minutes, I'll come back and the uploader window has just frozen. If I stop the eve clients from checking data, the client *might* eventually unfreeze and the log will scroll like crazy until it's caught up. Scrapyard Bob's suggestion sounds spot on, split the upload functions into different threads, so that the delay in waiting for responses from uploads isn't sending the whole uploader program to **** :)
I'm now running both upload tools at the same time - and letting them fight over the cache files. If EMK's uploader gets side-tracked and starts timing out, the EMD upload tool picks up the slack. |

Scrapyard Bob
EVE University Ivy League
440
|
Posted - 2011.12.05 04:55:00 -
[16] - Quote
http://www.evemarketeer.com/item/info/coolant
I see there is now a "top 5 regions buy/sell" box.
How is that calculate? Is it dropping regions that are more then 7-14 days out of date? |

Scrapyard Bob
EVE University Ivy League
447
|
Posted - 2011.12.06 18:39:00 -
[17] - Quote
Getting strange results from the EMK API feed.
http://www.evemarketeer.com/api/info/37_40_36_11399_38_35_34_39/xml/10000030/sell_lowest5
- This is only returning 7 rows, with the price for Tritanium (34) completely missing. - Also happens in The Forge region. |

Scrapyard Bob
EVE University Ivy League
452
|
Posted - 2011.12.10 23:18:00 -
[18] - Quote
Zaepho wrote: I don't suppose you have a log of these skew values to make an intelligent decision of how far off is commonly acceptable? I would think about 5 or 10 seconds should be MORE than plenty but I'm confident my machines talk to a decent NTP server on a regular basis :)
Well, the "windows time server" a.k.a. "time.windows.com" is commonly off by a bit. And older WinXP machines will only sync with the server about once a week unless you play with the registry or belong to a Windows domain. So 2-3 seconds is not uncommon on normal Windows boxes.
So I'd say 5 seconds should be fine, unless someone's machine is lagged in which case maybe you have to go with 10 seconds.
|

Scrapyard Bob
EVE University Ivy League
452
|
Posted - 2011.12.11 15:04:00 -
[19] - Quote
The existing EVEMarketeer uploader reports as about 47MB used (peak) in Win7 64bit. (The EMD uploader is very similar size.)
So unless you blow that up to more then 80-ish, you should be fine. |

Scrapyard Bob
EVE University Ivy League
452
|
Posted - 2011.12.13 04:12:00 -
[20] - Quote
Will try this when you release the new version (I promise). |
|

Scrapyard Bob
EVE University Ivy League
452
|
Posted - 2011.12.13 19:22:00 -
[21] - Quote
v0.2 of the unified uploader, it starts on Win7 64bit, creates an icon in the systray, but then never does anything. The log file contains:
Traceback (most recent call last): File "emkUploader.py", line 19, in module File "wx\_core.pyo", line 7981, in __init__ File "wx\_core.pyo", line 7555, in _BootstrapApp File "emkUploader.py", line 11, in OnInit File "UploaderFrame.pyo", line 70, in __init__ File "UploaderFrame.pyo", line 107, in initialize File "UploaderFrame.pyo", line 305, in installationAutodetectButtonClick AttributeError: Installation instance has no attribute 'folder_base' |

Scrapyard Bob
EVE University Ivy League
453
|
Posted - 2011.12.14 00:24:00 -
[22] - Quote
Searching for "plex" returns a page with a bunch of items that contains the word "plex". Which is all well and good.
But you can't click on the line that says "30 Day Pilot's License Extension (PLEX".
My guess is that it breaks due to the single-quote inside of the item's name. |

Scrapyard Bob
EVE University Ivy League
455
|
Posted - 2011.12.14 17:34:00 -
[23] - Quote
log entries for the 0.2b client
Exception in thread EVE Marketeer: Traceback (most recent call last): File "threading.pyo", line 552, in __bootstrap_inner File "Classes.pyo", line 381, in run File "UploaderFrame.pyo", line 94, in log File "wx\_controls.pyo", line 1850, in AppendText PyAssertionError: C++ assertion "m_count == -1 || m_count == -2" failed at ..\..\src\msw\textctrl.cpp(140) in UpdatesCountFilter::UpdatesCountFilter(): wrong initial m_updatesCount value
Also, I have to double-click the system tray icon to get it back to the foreground, in the past tools I only had to single-click the system tray icon to bring it forward.
The "endpoints" tab (or status tab) should also keep track of:
- How many market orders have been uploaded to each endpoint since the tool started running. - The average time, in seconds, that it took to give each upload to the endpoint server (from "I have something for you" to "okay, it's accepted" to gauge responsiveness). - How big the upload queue is for that particular endpoint. - Age (in seconds) of the oldest item in the endpoint's queue. |

Scrapyard Bob
EVE University Ivy League
455
|
Posted - 2011.12.15 04:11:00 -
[24] - Quote
0.3 is much nicer - it forgot my EMK key that I had entered in version 0.2, but that was no big deal. The stats are now much more informative and give a feel for "is it working" better then watching the list scroll by. |

Scrapyard Bob
EVE University Ivy League
455
|
Posted - 2011.12.15 04:43:00 -
[25] - Quote
Controller Vrelk wrote:I would recommend auto-generating the config file. That way when it is extracted, you don't overwrite the old config file that contains the keys, although I was paying attention not to overwrite it, some people may.
Ah, that's what I had done wrong - I deleted the contents of my EMK upload program folder, which contained the XML file, before upgrading to 0.3.
(It was able to pull the EMD key from my EMD upload client, so that's why it didn't forget the EMD key.) |

Scrapyard Bob
EVE University Ivy League
455
|
Posted - 2011.12.15 04:55:00 -
[26] - Quote
Controller Vrelk wrote:The uploader (0.3) isn't uploading anything for me. The queue size kept increasing until it hit 50 and then it stopped, but the uploads is still 1, which it did as soon as I opened it. It appears to be queuing everything and not uploading. I have a key entered for both EMK and EMD, and 0 for EC.
Mine uploaded about 450-550 to each of the (3) sites, then stopped working.
Attempting to close the uploader resulted in the following error:
Exception in thread Thread-4: Traceback (most recent call last): File "threading.pyo", line 552, in __bootstrap_inner File "Classes.pyo", line 303, in run File "Classes.pyo", line 329, in addNewFiles IOError: [Errno 13] Permission denied: 'C:\\Users\\ScrapyardBob\\AppData\\Local\\CCP\\EVE\\c_program_files_(x86)_ccp_eve31024_tranquility\\cache\\MachoNet\\87.237.38.200\\301\\CachedMethodCalls\\8c18.cache'
Now, that could possibly be because I still have the EMD's uploader running as a fail safe against the EMK uploader hanging / stopping.
Restarted it and it picks right up and processes again. Will watch and see whether it hangs at around the same point. |

Scrapyard Bob
EVE University Ivy League
455
|
Posted - 2011.12.15 05:03:00 -
[27] - Quote
Controller Vrelk wrote:The uploader (0.3) isn't uploading anything for me. The queue size kept increasing until it hit 50 and then it stopped, but the uploads is still 1, which it did as soon as I opened it. It appears to be queuing everything and not uploading. I have a key entered for both EMK and EMD, and 0 for EC.
I hit this bug too. After a few minutes of working fine (a few hundred uploads) it decided to stop uploading on all (3) threads and is just sitting there with the queue column at 50 and the current time column constantly counting upwards.
(The EMD uploader is still running strong, so EMD is up.)
While the "Wait until uploads are finished" message is nice, I'm wondering if you can eventually add a button to that dialog that says "Go ahead and exit" beside the "Oops, don't exit" button. |

Scrapyard Bob
EVE University Ivy League
455
|
Posted - 2011.12.15 05:07:00 -
[28] - Quote
Seems like the issue always happens after:
EVE Central: Upload unknown problem: EVE Central: Uploaded ##### in ######## EVE Central: None
The log has a few entries of:
Exception in thread EVE Central: Traceback (most recent call last): File "threading.pyo", line 552, in __bootstrap_inner File "Classes.pyo", line 399, in run AttributeError: 'NoneType' object has no attribute 'find'
|

Scrapyard Bob
EVE University Ivy League
456
|
Posted - 2011.12.16 05:42:00 -
[29] - Quote
Tool seems to be working better - but EVEMarketeer things that some/most of my uploads are coming from the future. (The other 2 endpoints are happy with the upload data, so I'm guessing that EMK is being too picky or has a clock that has drifted.) |

Scrapyard Bob
EVE University Ivy League
456
|
Posted - 2011.12.16 12:41:00 -
[30] - Quote
The crashes are still happening after a random amount of time.
Problem signature: Problem Event Name:APPCRASH Application Name:unifieduploader.exe Application Version:0.1.0.0 Application Timestamp:49180193 Fault Module Name:KERNELBASE.dll Fault Module Version:6.1.7601.17651 Fault Module Timestamp:4e211319 Exception Code:80000003 Exception Offset:0001280c OS Version:6.1.7601.2.1.0.256.48 Locale ID:1033 Additional Information 1:0a9e Additional Information 2:0a9e372d3b4ad19135b953a78882e789 Additional Information 3:0a9e Additional Information 4:0a9e372d3b4ad19135b953a78882e789
In this case, it had uploaded 3900 to EMK, 5751 to EMD, 6671 to EC. No log file was generated, nothing unusual in what can be seen of the Status window. Nothing unusual in the status columns, no full queues. |
|

Scrapyard Bob
EVE University Ivy League
456
|
Posted - 2011.12.16 21:48:00 -
[31] - Quote
Yeah, no cache file = nothing to grab.
Some possibly cheap fixes:
- When a type ID + region pair is handed out, update the record with a "last handed out" time stamp.
- Keep track of the last time that a particular typeID+region pair has gotten data. (Which you already do.)
1) With the presence of a "last handed out" time stamp, you could pull a list of stuff that needs checking, but exclude anything that was handed out in the previous N minutes (30 minutes might be good). That way if you have (2) clients checking a particular region, both will get slightly different lists to work from. This method does start to break down once you have (20+) clients all checking the same region at the same time, but that's a good problem to have.
2) In addition you might choose to add a few minutes/hours to the "last handed out" time stamp to delay checking them again. For example, if the "last update time" > 7 days, then push the "last handed out" time stamp 2.56 hours into the future. If the "last update time" > 14 days, then push the "last handed out time" 3.23 hours into the future.
"last handed out" = (now) + cube root of (# hours since last update / 10)
cube root (24/10) = 1.34 cube root (168/10) = 2.56 cube root (336/10) = 3.23 cube root (720/10) = 4.16 cube root(2160/10) = 6.00
(You may decide to divide by 30 or 50 instead of 10, to shorten up the last handed out bump.) |

Scrapyard Bob
EVE University Ivy League
456
|
Posted - 2011.12.16 23:14:00 -
[32] - Quote
It's mostly to deal with the issue of things like the Deadeyes where if you haven't seen it in a month or three months, then it's probably not worth checking for near as often. Depending on what factors you use as the divisor, you'd still be handing it out a few times per day, just not every single time. As long as the different sites (such as EMD/EC) do their algorithms slightly differently, it shouldn't be a weakness.
And there's still the issue where the EMK scanner page "breaks" after 2-3 hours and stops opening up the market window, even though the page is still refreshing. My guess is that you're up against some sort of bug in the web browser, or you're generating requests slightly faster then the 3 second rule. I'm still using eve-marketdata's market scanner page whenever I do my overnight updates. |

Scrapyard Bob
EVE University Ivy League
456
|
Posted - 2011.12.17 21:50:00 -
[33] - Quote
It tends to crash sooner if you leave the window open then if you minimize it (not fully verified, but a working hypothesis).
EVE Marketeer endpoint log:
Traceback (most recent call last): File "Classes.pyo", line 423, in run File "UploaderFrame.pyo", line 119, in log File "wx\_controls.pyo", line 1850, in AppendText PyAssertionError: C++ assertion "m_count == -1 || m_count == -2" failed at ..\..\src\msw\textctrl.cpp(140) in UpdatesCountFilter::UpdatesCountFilter(): wrong initial m_updatesCount value
EMD endpoint log:
Traceback (most recent call last): File "Classes.pyo", line 423, in run File "UploaderFrame.pyo", line 122, in log File "wx\_controls.pyo", line 1818, in Remove PyAssertionError: C++ assertion "m_count == -1 || m_count == -2" failed at ..\..\src\msw\textctrl.cpp(140) in UpdatesCountFilter::UpdatesCountFilter(): wrong initial m_updatesCount value
EC endpoint log:
Traceback (most recent call last): File "Classes.pyo", line 423, in run File "UploaderFrame.pyo", line 119, in log File "wx\_controls.pyo", line 1850, in AppendText PyAssertionError: C++ assertion "m_count == -1 || m_count == -2" failed at ..\..\src\msw\textctrl.cpp(140) in UpdatesCountFilter::UpdatesCountFilter(): wrong initial m_updatesCount value
file reader log - nothing. |

Scrapyard Bob
EVE University Ivy League
456
|
Posted - 2011.12.17 22:12:00 -
[34] - Quote
Scrapyard Bob wrote:It tends to crash sooner if you leave the window open then if you minimize it (not fully verified, but a working hypothesis).
Working hypothesis disproven, it still crashes frequently when minimized to the system tray.
My guess is that once you get too many of the following - it just ups and dies:
Traceback (most recent call last): File "Classes.pyo", line 423, in run File "UploaderFrame.pyo", line 122, in log File "wx\_controls.pyo", line 1818, in Remove PyAssertionError: C++ assertion "m_count == -1 || m_count == -2" failed at ..\..\src\msw\textctrl.cpp(140) in UpdatesCountFilter::UpdatesCountFilter(): wrong initial m_updatesCount value
The log files are full of the above message.
|

Scrapyard Bob
EVE University Ivy League
457
|
Posted - 2011.12.18 07:52:00 -
[35] - Quote
Callean Drevus wrote:I know, I've been having these messages for the better part of the day, and my uploader still hasn't crashed...
What does it do? Does it simply hang? Or does it seem to not do anything anymore (but still being responsive)?
It just keeps crashing on Win7 64bit - minimized, not minimized. I'm running 4 clients at it at the same time, so it's under a bit of stress. But it never uses much CPU and stays with a peak working set of about 39MB. It can run for an hour and not crash, or crash after 5 minutes, no set pattern - which means it's probably reacting to either a particular item, or a network condition when talking to the end point servers.
I can't tell whether the errors are related to the crash or just background noise, but it's the only thing showing up in the log files.
|

Scrapyard Bob
EVE University Ivy League
457
|
Posted - 2011.12.18 09:09:00 -
[36] - Quote
Not sure then - will do a fresh install folder and see what happens.
When I do my uploads overnight, I run multiple clients, all from the same cache directory. Sometimes 2 in the same region.
The new upload page does seem to be much better behaved and doesn't stop working like the old one did. (Nice "Christmas" theme *grin*) |

Scrapyard Bob
EVE University Ivy League
457
|
Posted - 2011.12.18 18:26:00 -
[37] - Quote
Mine paused uploading today, new error message:
Traceback (most recent call last): File "Classes.pyo", line 427, in run AttributeError: 'NoneType' object has no attribute 'find'
Also, I finally got the EMK uploader to fight over a cache file with the EMD uploader and got this in the file reader log file:
Traceback (most recent call last): File "Classes.pyo", line 310, in run File "Classes.pyo", line 339, in addNewFiles IOError: [Errno 13] Permission denied: 'C:\\Users\\ScrapyardBob\\AppData\\Local\\CCP\\EVE\\c_program_files_(x86)_ccp_eve31024_tranquility\\cache\\MachoNet\\87.237.38.200\\301\\CachedMethodCalls\\7d4d.cache'
|

Scrapyard Bob
EVE University Ivy League
459
|
Posted - 2011.12.19 15:10:00 -
[38] - Quote
Domi Etymology wrote:oh god, what did you do? the market page just keeps giving me gypsy and noble implants to attempt to upload, except there's none on the market, hence no uploads......
Looks like it might need some tuning. (I often switch between using eve-marketdata's scanner page, eve-central's page, and EMK's page through the week.)
Thinks about the numbers... There are 6922 possible market items, 3.5 seconds per item. In an ideal world, that means you can scan the market with a single alt in the space of 6.73 hours (5.77 hours w/ the 3 sec version, but that breaks). If we have (2) bits of information (last upload, last handed out), then we need to penalize items that haven't updated recently and which have also been handed out recently. Logic dictates that you should create a 3rd field to handle this desired result and call it "next possible queue time", which makes the market scanner's page a lot simpler.
LUT = last upload time stamp (defaults to something like the start of the epoch, or something like January 2000) LHO = last handed out time NQT = next queue time (defaults to start of epoch)
NQT should be updated when either an item is handed out, or a successful upload arrives.
LHO event -> set NQT to current time + cuberoot(# hours since LUT / 25) + random(1800 seconds) - So as items are handed out, they get pushed down deeper into the stack, which will bubble other items up to the top. - Adds a bit of randomness to move things up/down by a maximum 15 minutes - The "25" divisor gives good results for items which are only seen once a year (bumps them by 7.05 hours)
LUT event (successful upload) -> set NQT to current time + 8 hours + random(4 hours) - When an item is successfully uploaded, it needs to move down towards the bottom of the stack - Since the 6922*3.5 sec = 6.73 hours, the magic number is 8 hours plus up to 4 hours
Now for the reason that we use a NQT field instead of looking at the LHO/LUT fields when figuring out what the market scanner should hand out next. When the market scanner page needs to pull 20 items to hand out, it should query the item field, sorting on NQT in ascending order, top 20 items. This way, you always get 20 items, even if the NQT values are hours/days into the future.
|

Scrapyard Bob
EVE University Ivy League
459
|
Posted - 2011.12.19 17:21:00 -
[39] - Quote
Callean Drevus wrote:Seems like I'll have to grab my old and dusty two alts then to do a bit of stress testing on the uploader, it must be related to uploading from multiple accounts at the same time.
I can trigger it by using the EMD market scanner page, using just two accounts - even if the accounts don't share a cache directory. More simultaneous accounts just triggers the bug faster / more often. |

Scrapyard Bob
EVE University Ivy League
460
|
Posted - 2011.12.21 15:36:00 -
[40] - Quote
I'll beat on the 0.4 version of the uploader today.
Also, the market scanner page seems a bit odd still when viewed in the in-game browser. Sometimes the icons go down the left side of the page, other times they just go in a line across. Could be browser width issues. (Will try and figure out more later.) |
|

Scrapyard Bob
EVE University Ivy League
461
|
Posted - 2011.12.21 20:13:00 -
[41] - Quote
Callean Drevus wrote:That might be caching issues, but I'm not sure. Only time I've seen something like that was the first time I loaded the page.
Yes, possibly cache issue, the site is now behaving on the clients where I'm running them at 1024x768 (so the browser window is only around 850-900 wide.
So far 0.4 of the uploader is passing with flying colors at keeping up with (3) simultaneous market scan clients running. Memory peaked out at around 62.4MB, CPU usage has been negligible. I've uploaded about 14k to each of the (3) endpoints in today's session.
I used EMD's scanner site for most of the day, but will switch over to using the EMK's scanner tomorrow.
Other small notes:
- The XML/JSON/CSV links on individual item pages all point at the "xml" version of the URL
- The location of the regional drop down still feels too far out of place in the upper right, maybe it should be where the item's icon is on an individual item's page. This would probably force you to move the item's icon to the left side of that area.
- Price history graphs look like they broke 3 weeks back and haven't updated.
- It would be nice if I'm on a particular item's page (say Tritanium) that I could click on a link next to the item's name (such as "Minerals") which would take me to a market group summary page for that particular item.
- Longer term wish, being able to see an entire market group (i.e. "Minerals"), with the individual items down the left and the top 5 market regions identified as column headers with the 5% buy/sell prices as the cell contents. Ignoring issues with color blindness, if values where the individual region is 5% above/below the average of the top-5 market price was colored green/red, that might be useful. Prices listed would only need to have about 4-5 decimal places of precision. This means you could switch to "k", "M", "B", "T" suffixes to trim digits off the tail end. The average price in the entire grid should control which suffix to use (up to 50,000 use no divisor, up to 1M use the 'k', up to 1B use the 'M', up to 1T use the 'B'). So you would get numbers like 4385.20, 43850.20, 438.52k, 4.3852M, 43.852M, 438.52M, 4.3852B, 43.852B, 438.52B, 4.3852T, etc.
|

Scrapyard Bob
EVE University Ivy League
461
|
Posted - 2011.12.22 18:26:00 -
[42] - Quote
0.4 is still working fine, even with multiple clients running (same region, same cache folder, etc.). Zero errors in the log files now. The market scanner page also continues to perform well.
Minor requests for the 0.4 client:
- Add a "restore" option to the right-click menu of the system tray icon. - When I double-click on the sys tray icon, it always comes back to the foreground in a minimized state. - Upload keys might need to be moved out of "config.ini" and into a "user.ini".
|

Scrapyard Bob
EVE University Ivy League
461
|
Posted - 2011.12.24 13:16:00 -
[43] - Quote
Windows XP error (trying to install on the laptop, where it's never been installed before).
Traceback (most recent call last): File "emkUploader.py", line 19, in (module) File "wx\_core.pyo", line 7981, in __init__ File "wx\_core.pyo", line 7555, in _BootstrapApp File "emkUploader.py", line 11, in OnInit File "UploaderFrame.pyo", line 96, in __init__ File "UploaderFrame.pyo", line 150, in initialize File "UploaderFrame.pyo", line 344, in installationAutodetectButtonClick File "os.pyo", line 423, in __getitem__ KeyError: 'LOCALAPPDATA' |

Scrapyard Bob
EVE University Ivy League
462
|
Posted - 2011.12.24 13:54:00 -
[44] - Quote
I figured out a new way to break the API call by putting garbage in for the type IDs.
http://www.evemarketeer.com/api/info/32_#N/A_33_#N/A_#N/A_#N/A_#N/A_#N/A_#N/A_#N/A/xml/10000002/sell_lowest5
This results in the error:
MYSQL ERROR OCCURRED: You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ') AND station_id = 0 ORDER BY FIELD(type_id, 32,)' at line 1
Which may possibly mean that you are vulnerable to a SQL injection. You'll need to ensure that those values are forced into numeric types before passing them to the SQL engine. |

Scrapyard Bob
EVE University Ivy League
463
|
Posted - 2011.12.27 14:49:00 -
[45] - Quote
http://www.evemarketeer.com/api/info/34_35_36_37_38_39_40_11399/xml/10000002/sell_lowest5
Is showing zero data for Pyerite, Mexallon and Zydrine this morning.
http://www.evemarketeer.com/item/info/pyerite http://www.evemarketeer.com/item/info/zydrine http://www.evemarketeer.com/item/info/mexallon
|

Scrapyard Bob
EVE University Ivy League
570
|
Posted - 2012.01.01 01:51:00 -
[46] - Quote
On the market scanner page where it shows "(6857 / 6922 updated in last 24 hours)" - that number does not appear to be updating as time goes on. So, for instance if it shows 12% has been updated in the last 24 hours, then you look at the regional page it will say something far higher after a few hours.
Also, the regional status page does not always render the first time visited in Firefox. I have to go to that URL, then force a page reload in order for it to display properly. It's a hit/miss error, possibly cache related. It may only happen once per hour (as the page gets updated).
http://www.evemarketeer.com/statistics/regions
PS: The unified uploader is running happily, 174k cache files processed since it started and no crashes. There does seem to be a memory leak somewhere because it's up to 257MB of "peak working memory" with 183MB in current use (174MB private/commit size). It started at around 35-40MB when first launched. |

Scrapyard Bob
EVE University Ivy League
575
|
Posted - 2012.01.01 23:12:00 -
[47] - Quote
Callean Drevus wrote: Good to hear that the unified uploader is running happily. I wonder what is causing the large memory consumption though. How long have you had it running?
A a guess, somewhere around 9 days and 174,000 cache files processed. So it's a fairly slow memory leak. I have 16GB of RAM, but I could see that being an issue for others.
The ".log" files don't put time-stamps in when they start-up (it just says "Logger started").
|

Scrapyard Bob
EVE University Ivy League
581
|
Posted - 2012.01.04 08:13:00 -
[48] - Quote
And a small bump because the history tab is showing chart history that only goes through Nov 27th.
http://www.evemarketeer.com/item/info/pyerite
(It's probably already on your to-do list.) |

Scrapyard Bob
EVE University Ivy League
582
|
Posted - 2012.01.04 14:18:00 -
[49] - Quote
Which reminds me of a question. For eve-marketdata, you had to manually switch your market screen to be looking at the "history" tab in order for it to gather data before running scans. Is that still true that the market history cache files will not be generated if you do not specifically switch to the "history" tab?
|

Scrapyard Bob
EVE University Ivy League
586
|
Posted - 2012.01.07 03:57:00 -
[50] - Quote
One request that came in through a private convo today with someone. This particular user also runs their own cache-scanning software.
The new uploader no longer has the option of "leave cache files in place" (i.e. "don't delete"). Or maybe we need an option of "delete after N hours".
|
|

Scrapyard Bob
EVE University Ivy League
586
|
Posted - 2012.01.07 15:09:00 -
[51] - Quote
Ooops, guess I shouldn't post requests when running on 3 hours of sleep.
On the history graph, the little tool-tip that shows you the price value as you mouse-over the lines on the graph is very hard to read. Can you make the background more opaque and increase the contrast of the text color in relationship to the background? |

Scrapyard Bob
EVE University Ivy League
586
|
Posted - 2012.01.09 00:09:00 -
[52] - Quote
(big list incoming)
Also, on the history graph, it needs to filter out outliers before setting the scale. A good example is the orca price in the forge.
http://www.evemarketeer.com/item/info/orca - Someone put one up for sale in Jita at about 10x above the other prices, pushing the scale out of whack
...
Group summary links are still non-functional. Which kind of goes back to my previous suggestion of showing the item name along with the 5% buy sim price for the top (4) market regions on each row. So when I look at:
http://www.evemarketeer.com/item/group_summary/18
I would see:
(item) The Forge / Domain / Sinq Laison / Heimatar Tritanium - 4.35 / 3.94 / 3.38 / 3.90 Pyerite - 5.33 / 5.30 / 4.96 / 5.11 etc.
If the average of values are above 100k, then it should switch to displaying the entire page in thousands, above 100M, in millions.
For the parent group (which does not contain actual items, only other market groups) it wouldn't make sense to display the prices. For instance, the parent group of "Materials" or "Ore & Minerals".
http://www.evemarketeer.com/item/group_summary/1031 http://www.evemarketeer.com/item/group_summary/533
...
On the regional drop-down, it would be nice if you would add "meta" regions like:
-1 = All -2 = High-Sec Only -3 = Lo-Sec Only -4 = High/Low Only
(Swiped from EVE-MarketData's URLs for prices.) |

Scrapyard Bob
EVE University Ivy League
598
|
Posted - 2012.01.11 00:32:00 -
[53] - Quote
Group summary pages look very good, other then its choice of the (4) regions to show for minerals:
http://www.evemarketeer.com/item/group_summary/18 - The Forge (yep, there's Jita) - Delve (uh...) - Heimatar (yep, that's Rens) - Domain (yep, Amarr)
http://www.evemarketeer.com/item/group_summary/476 - That one uses the (4) recognized market hub regions.
I'm thinking you may want to just force the top (4) regions. Or limit your heuristic to empire regions with data less then 15 days old (Delve is 45-60 days out of date).
|

Scrapyard Bob
EVE University Ivy League
598
|
Posted - 2012.01.11 00:44:00 -
[54] - Quote
One more thing (hah, right) for the group summary page - which is very nice :)
The ability to click on one of the numbers to take me to that region's sell page so I can see the sell orders for that item in that region.
Okay, make that two things.
It would be useful if the page title would change depending on what you're viewing. So when looking at:
"EVE Marketeer - Group Summary - Standard Battlecruisers - Minmatar" http://www.evemarketeer.com/item/group_summary/473
"EVE Marketeer - Item - Tornado" http://www.evemarketeer.com/item/info/Tornado |

Scrapyard Bob
EVE University Ivy League
598
|
Posted - 2012.01.11 05:15:00 -
[55] - Quote
If you're interested in seeing market history uploaded more often, the regional status page needs to report on this.
- Drop the "% with last year" column. If the data hasn't been updated within the past month, it's not very useful at all. Have the Last hour/day/week/month fields only report on buy/sell order data freshness. Drop any items which have not had updates within the previous 365 days from the average as they're items that you'll probably never see.
- Add a new column for how fresh regional history data is and put it after the "Avg Time Ago" number. Call it "History Age" or "Order History". Again, drop anything older then 365 days before calculating the average age.
- The market scanner page will need to report both how fresh the buy/sell order data is (average age) as well as displaying the average history data age. I suggest always displaying both numbers rather then doing it like EMD where you have to flip to the other page to see how fresh the history data is. If both numbers are "in my face" when I hit the market scanner page, I can make an educated decision whether to set the market window to history or order details for this particular session. |

Scrapyard Bob
EVE University Ivy League
602
|
Posted - 2012.01.11 23:03:00 -
[56] - Quote
Nice changes to the group summary pages (including links and customizable region selection).
I think it's a toss-up whether the group summary pages should be sorted by name or TypeID. For the Minerals page, TypeID sorting makes more sense. But for a page like the following, sorting by name would make more sense:
http://www.evemarketeer.com/item/group_summary/265
The gripping hand options might be:
- TypeID sort in cases where there are less then 10 items in the group. - Or a custom list of groups where they should be sorted by TypeID. |

Scrapyard Bob
EVE University Ivy League
605
|
Posted - 2012.01.13 03:39:00 -
[57] - Quote
On the group summary pages; right now you have "buy" and "sell" in the drop down menu. Can this be expanded to:
http://www.evemarketeer.com/item/group_summary/1337/sell
"Sell (5% simulated buy)" - the default (or remember it if I have a login profile) "Sell (lowest)" "30-day average" "Buy (5% simulated sell)" "Buy (highest)" - the current default, which I always change to "sell (lowest)"
Which leads in to a question about the "item API". Now that you're starting to gather information on history, it might be useful to calculate for each item a 30-day average taking the order history within the past 30 days and giving us:
- average # units sold per day - average price per item sold
i.e.
http://www.evemarketeer.com/api/info/34/xml/10000043/30d_units_per_day http://www.evemarketeer.com/api/info/34/xml/10000043/30d_avg_price
That would give us an idea of how many units are changing hands per day over the past month in each region. |

Scrapyard Bob
EVE University Ivy League
608
|
Posted - 2012.01.14 19:38:00 -
[58] - Quote
Depends on the day. I always try and make a point to update (3) regions at night (Heim/Metro/Sinq), but I'll sometimes run the scanner during the day for Heimatar/Sinq. Especially if the market is chaotic that week with lots of price swings through the day. I'll also sometimes float the 3rd alt's account around and hit up different regions.
We definitely need more people in places like Everyshore, Tash-Murkon, Domain, Citadel, Lonetrek, etc
|

Scrapyard Bob
EVE University Ivy League
609
|
Posted - 2012.01.15 17:52:00 -
[59] - Quote
Also, maybe the "top uploaders" list should be done based off of credits rather then raw uploads.
Then you could award more/less credits in order to skew towards the behavior that you want. (Looking at the upload history, this already seems to happen somewhat. Sometimes I get 0.1 credits, sometimes I get 5-15 credits per upload item.)
|

Scrapyard Bob
EVE University Ivy League
609
|
Posted - 2012.01.15 20:51:00 -
[60] - Quote
Callean Drevus wrote:@Scrapyard: Can you possibly have missed the fact that the second table on the top uploaders page is sorted by amount of credits? The credit system works as you describe  , the minimum value is 0.1, for an upload which add absolutely nothing (see, repeat uploading), to 25 for an upload that redefines the stats for the entire region.
Yes, but does that control who shows up on the front page? Or is that off of raw upload count?
(And thanks, I was curious how some of the scores were calculated.) |
|

Scrapyard Bob
EVE University Ivy League
609
|
Posted - 2012.01.16 19:31:00 -
[61] - Quote
6ie wrote:Possibly the uploader cant handle 3 clients at once?
It shouldn't have an issue like that - I used to break 0.3 and 0.4 all the time with running (3) clients. But since 0.4b, haven't had a lick of trouble with the uploader (even with 3 clients, all feeding the same cache folder, or running off of diff cache folders, same region, diff region). So far, 5 days running, 235k files read, 234k files deleted by the Zeropoint reader.
But I'm on Win7 64bit.
I show about 20.4k files in my MachoNet cached objects folder. |

Scrapyard Bob
EVE University Ivy League
615
|
Posted - 2012.01.18 04:02:00 -
[62] - Quote
http://prices.c0rporation.com/
Looks like you have to hand-submit prices for items sold via contracts. Not sure whether viewing a contract causes it to be written out to a cache file.
(Can't think of any other faction price sites off-hand.) |

Scrapyard Bob
EVE University Ivy League
631
|
Posted - 2012.01.21 14:27:00 -
[63] - Quote
I prefer the old "start/stop" button being on the far right edge - made it easier to pause the updating because I could set things up so that the browser was still visible behind the market window. (This matters more on 1024x768 client windows, where space is limited.)
I'm also curious whether you can tone down the frequency of update for the 3.5 sec counter, maybe only update every 0.5 seconds. It now seems to cause graphical lag issues, even when the clients are minimized. |

Scrapyard Bob
EVE University Ivy League
631
|
Posted - 2012.01.21 14:58:00 -
[64] - Quote
I'm not entirely convinced that it's EMK's site that is doing it, I think one of the recent updates to the EVE client borked things. It used to be that when I minimized a market scanning window, the EVE client went from using 80% of a CPU core down to about 20-30% of a single CPU core. Now, the EVE clients are a lot more piggy about using the CPU - so it may be a CCP thing.
As long as the start/stop button is as far left/right as possible in the browser window, I can adjust. The advantage to having it on the right side is that the browser's "close" buttons are then available in cases where the client is laggy and hitting the "stop/pause" button doesn't seem to be working. If I put the browser left and market window to the right, the market window covers up those minimize/close window controls (making it harder to shutdown the IGB if it's laggy).
Also, this started yesterday on the group summary pages: http://www.evemarketeer.com/item/group_summary/78 MYSQL ERROR OCCURRED: Unknown column 'ji0.sell' in 'field list' |

Scrapyard Bob
EVE University Ivy League
635
|
Posted - 2012.01.24 14:45:00 -
[65] - Quote
The new unified uploader doesn't seem to be reading the cache properly after today's patch.
(And maybe you'll want to break out issues with the Unified Uploader to a new thread?)
Edit: The 2.6 EMD uploader works fine (so will use that today). |

Scrapyard Bob
EVE University Ivy League
637
|
Posted - 2012.01.24 23:36:00 -
[66] - Quote
Callean Drevus wrote:Have you tried restarting it? :P It should be an issue with the autodetected cache folder, so in the worst case, removing that from the config file and starting the uploader should work.
It's working now, but was definitely not working earlier (even after restarting the uploader twice).
I can only guess that I hadn't fired up every single junction mapping that I use (I have 3, and I had only fired up 2 earlier, so 1 of the junctions didn't have the latest "client update"). Or things were extra wonky earlier today.
|

Scrapyard Bob
EVE University Ivy League
650
|
Posted - 2012.01.27 06:44:00 -
[67] - Quote
http://www.evemarketeer.com/statistics/regions
Is showing strange data in the average age column. |

Scrapyard Bob
EVE University Ivy League
662
|
Posted - 2012.01.31 04:12:00 -
[68] - Quote
In fact, if you run any of the "upload" tools - you can mix and match with any of the "in-game browser market scanner pages" (or write your own page).
For a very long time, I ran the EMD's uploader, but used either EMK or the EveCentral's market scanner page. Or ran the unified uploader, then used any of EMD's / EMK's or EC's market scanning page.
For fun, I tried running the unified uploader under WINE 1.2 on Ubuntu.
Traceback (most recent call last):
File "emkUploader.py", line 5, in (module)
File "zipextimporter.pyo", line 82, in load_module
File "wx\__init__.pyo", line 45, in (module)
File "zipextimporter.pyo", line 82, in load_module
File "wx\_core.pyo", line 4, in (module)
File "zipextimporter.pyo", line 98, in load_module
ImportError: MemoryLoadLibrary failed loading wx\_core_.pyd
(Since I don't run EVE on Linux, I don't plan on troubleshooting this any deeper.) |

Scrapyard Bob
EVE University Ivy League
662
|
Posted - 2012.02.02 13:21:00 -
[69] - Quote
Any ideas / plans yet on adding "virtual" regions to the list of regions? You'd definitely need to do the calculations based only on orders downloaded within the past 7 days. https://forums.eveonline.com/default.aspx?g=posts&m=623346#post623346
I also figured out why the EVE client was being so piggy about the CPU when doing "history" scans. The market window is very inefficient at drawing those history graphs. Switching to "Show Table" view keeps things humming along nicely. |

Scrapyard Bob
EVE University Ivy League
662
|
Posted - 2012.02.02 13:30:00 -
[70] - Quote
Also, the "play" button to start/pause scanning is fine on the left. I've figured out that I can click the "GO" button in the IGB to pause scanning. (Please make sure that you don't auto-restart scanning based on the status of some cookie.)
|
|

Scrapyard Bob
EVE University Ivy League
662
|
Posted - 2012.02.02 14:20:00 -
[71] - Quote
What is the \Q/ at the top of the screen for?
One interesting statistic that I'm curious about: What systems have the highest trade volume per day, maybe a list of those where the 7-day moving average puts them into the top 25 systems. Repeated for regions too. The Statistics/Market for the regions is interesting, but since there's a ton of "junk" orders for outrageous prices, the "Sell Total" number isn't very accurate.
Maybe add "7-day transaction total" column to the new statistics/market window. Which might give us a better feel for which regions turn over the most ISK/wk. |

Scrapyard Bob
EVE University Ivy League
663
|
Posted - 2012.02.02 22:56:00 -
[72] - Quote
Callean Drevus wrote:Quote:Awesome new tool with the Best Loyalty Points functionality. Is there anyway to restrict it to a certain type? ie: caldari navy LPs, or Amarr Navy, LPs, etc? Not yet, but it is on the backlog :P Quote:Any ideas / plans yet on adding "virtual" regions to the list of regions? You'd definitely need to do the calculations based only on orders downloaded within the past 7 days. I have long been thinking of adding virtual characters, but virtual regions are new. That said, there is no reason not to add them. Are you talking now about arbitrary regions combined, or arbitrary security ratings combined?
Both. But not completely arbitrary, just some major pre-defined groupings. Such as the "hi-sec" price or "market hubs" price.
For instance, on EMD, I can get a price for a Naga across all of hi-sec: http://eve-marketdata.com/price_check.php?step=Show&type_id=4306&type=sell®ion_id=-2
Or just lo-sec: http://eve-marketdata.com/price_check.php?step=Show&type_id=4306&type=sell®ion_id=-3
Or both: http://eve-marketdata.com/price_check.php?step=Show&type_id=4306&type=sell®ion_id=-4
EMD doesn't currently offer a "market hub" option. And it doesn't filter out orders which haven't been updated or downloaded in the past few weeks, so sometimes you get a page of useless information.
Being able to pull an API value for a particular item in a virtual region composed of "all hi-sec, all lo-sec, empire, or null, or market hubs" would be useful as a way of getting a closer valuation of a particular item then just going with the Jita price. While Jita's sell prices are usually the lowest, if there is market manipulation occurring, Jita sell prices can get very whacky. In which case, the long-term value is probably closer to the average of the other (3) market hubs.
So by doing the 5% simulated buy across all (4) market regions or all of hi-sec, I'm hoping that it would give better values for tools like jEvEAssets, EvEHQ, EvEMeep or spreadsheets. Better option then relying on just Jita pricing.
I think a good list of virtual regions would be:
"hi-sec" - any hi-sec station gets included in this price "lo-sec" - same, but for lo-sec stations "null-sec" - same, but for null-sec "empire" - include both hi-sec and low-sec stations "main market hubs" - roll-up Jita, Amarr, Dodixie and Rens "main market regions" - hi-sec stations in Domain, Forge, Heimatar and Sinq Laison
I'd suggest filtering out any orders not updated within the past 7 or 14 days, no sense handing out bad information in these roll-up "virtual" regions. |

Scrapyard Bob
EVE University Ivy League
663
|
Posted - 2012.02.02 22:59:00 -
[73] - Quote
EMD's market scanner page would sometimes auto-restart, which is why I didn't consider that a viable method of pausing the EMD's market scanning page.
EMK's market scanner page does not automatically restart. This is a good thing.
(Yes, I could close the in-game browser window, but that little "x" can be difficult to hit if the client starts lagging. The "Go" button is a lot larger, and the play/pause button is even bigger.) |

Scrapyard Bob
EVE University Ivy League
663
|
Posted - 2012.02.03 11:45:00 -
[74] - Quote
(chuckle) Oh look, I'm not the only one who can break things!
\Q/
In that 3rd URL, in the sequence "2308_2309_2393", the 2309 is being dropped from the result set. http://www.evemarketeer.com/item/info/2309
Also in the sequence: 2306_2307_2308, the 2307 is missing http://www.evemarketeer.com/item/info/2307
Region #43 is Domain.
Now the odd thing is that I have almost the exact same query in one of my sheets, but I'm only pulling 24 at once, and #2307 shows up fine for me (along with 2309).
http://www.evemarketeer.com/api/info/2268_2305_2267_2288_2287_2307_2272_2309_2073_2310_2270_2306_2286_2311_2308_2393_2396_3779_2401_2390_2397_2392_3683_2389/xml/10000043/sell_lowest5 |

Scrapyard Bob
EVE University Ivy League
672
|
Posted - 2012.02.05 11:20:00 -
[75] - Quote
When I was trying out the Loyalty point stuff last night... (loving the feature, BTW).
- It proved to be impossible, once you picked a faction and then changed the corp to a specific one within the faction to get the corp drop down to go back to "All" without changing factions and then going back to the same faction.
1. Pick faction 2. Pick corp 3. decide you want to go back to seeing "all" corps, change back to "all" 4. corp-drop down keeps resetting to list the last corp you looked at after submit
(So there's definitely a problem in both the corp/faction pull-downs where you can't get them back to "all".)
- When looking at an item details, the "LP Store" tab was always blank, but only for some items. Some worked, some didn't.
http://www.evemarketeer.com/item/info/27187 http://www.evemarketeer.com/item/info/27231
- Value column in the bestloyaltypoints page may need an option to work off of the 5-day or 7-day or 30-day moving average historical price rather then sell/buy.
http://www.evemarketeer.com/item/info/27231 (This item seems to only ever change hands for 900k to 2.1M ISK, but the 5% number in the Forge is 15M ISK.)
- Because of the length of names on things like Implants, the mouse-over tool-tip text for the Type column links should probably be changed from "View EMK item information" to the name of the page that you are linking to. But at least the columns are resizable.
|

Scrapyard Bob
EVE University Ivy League
672
|
Posted - 2012.02.05 20:38:00 -
[76] - Quote
30-day average price drop-down on the LP page, doesn't seem to actually work. It's still displaying the sell.
1. Change drop down to "Sell Price" 2. Page refreshes, it goes back to saying "Average Price (30d)"
1. Change drop down to "Buy Price" 2. Page refreshes, value change, but drop-list goes back to saying "Average Price (30d)"
|

Scrapyard Bob
EVE University Ivy League
672
|
Posted - 2012.02.06 15:33:00 -
[77] - Quote
http://www.evemarketeer.com/item/info/27102 - The LP Stores tab lists all LP items, not just entries for the item being viewed
|

Scrapyard Bob
EVE University Ivy League
672
|
Posted - 2012.02.07 01:14:00 -
[78] - Quote
Out of curiosity, do we get more credits for uploading history for outdated regions? Or do we always get the same points? |

Scrapyard Bob
EVE University Ivy League
672
|
Posted - 2012.02.07 01:27:00 -
[79] - Quote
Callean Drevus wrote: QUOTE: The LP Stores tab lists all LP items, not just entries for the item being viewed
It just looks like there are a LOT of locations where you can obtain that item to me, no different items at all (all LP and ISK cost is the same, the only thing that differs is faction, corp and location). Can you screenshot this one if you really think there's something wrong?
Ah, okay, I see. The mass of data made me avoid looking at it in detail because it was so repetitive. But since prices never vary at all across different stations for a particular corp it may be better to:
- Drop the Station column. - Make the corporation name a hyper-link to information about that corporation. - Add another page somewhere else detailing the corporation information.
Which would shorten up that list a lot. When I was looking at that tab, my interest is more along the lines of "I want this, which NPC corps sell it?", not "exactly which stations sell it". So if I want to earn a specific implant, what corps would I have to go grind for?
On the "NPC corporation information" page, you could then have tabs for:
- Stations (with Region / Constellation / System / Station / Jumps Away) - Agents (Type / Level / Region / Constellation / System / Station / Jumps Away) - Locator agents (Region / Constellation / System / Station / Level / Jumps Away)
Some of the above is optional and would basically be groundwork for an "agent finder" type tool. Jumps away would be a useful feature to pull the current location from the IGB.
Now, the natural downside is that you would not be able to have one big list of sortable station names to figure out where a specific implant is found. But I think that if you've earned enough LP with a particular corp by doing missions, then you should already have a fairly good idea of where they are located. And you would probably be looking at your Journal to see which corps you have enough LP earned with, which is also a corporation-central view leading to the next question of "where does this corporation have offices and how far away are they". |

Scrapyard Bob
EVE University Ivy League
672
|
Posted - 2012.02.07 01:54:00 -
[80] - Quote
Oops, it broke:
Warning: mysql_select_db() expects parameter 2 to be resource, boolean given in /var/www/www.evemarketeer.com/core/lib/cordb/cordb.php on line 38 Warning: mysql_ping() expects parameter 1 to be resource, boolean given in /var/www/www.evemarketeer.com/core/lib/cordb/cordb.php on line 29 Database connection #0 failed |
|

Scrapyard Bob
EVE University Ivy League
673
|
Posted - 2012.02.09 06:42:00 -
[81] - Quote
Dragonaire wrote:So it's also effecting uploads now 
Days like these, I just point my in-game browser at either eve-marketdata market scanner page or eve-central's upload suggestions page.
|

Scrapyard Bob
EVE University Ivy League
677
|
Posted - 2012.02.10 16:20:00 -
[82] - Quote
Database errors are still happening on a regular basis, both in the uploads queue as well as various pages on the website.
At a rough guess, about 1/4 of all uploads are failing, and 10-20% of the web page hits. |

Scrapyard Bob
EVE University Ivy League
677
|
Posted - 2012.02.10 19:23:00 -
[83] - Quote
From the uploader over the past few days:
EVE Marketeer - 51.6k EVE MarketData - 68.4k
So EVEMarketeer, which usually runs neck and neck with EMD, is losing about 25% of the upload attempts due to the database error.
|

Scrapyard Bob
EVE University Ivy League
677
|
Posted - 2012.02.11 06:57:00 -
[84] - Quote
Another wish item for the LP "best loyalty points".
- Sort the two drop-lists in alphabetical order before presenting it to the client.
And another argument in favor of only showing the list of corps that sell a particular LP item rather then every single station.
http://www.evemarketeer.com/item/info/9956
3393 rows returned on the LP Stores tab for that item, which takes a bit to load. :) |

Scrapyard Bob
EVE University Ivy League
682
|
Posted - 2012.02.13 14:27:00 -
[85] - Quote
Vaerah Vahrokha wrote: - Instead nothing happens and the top search box gets filled by a "29668" number, which I suspect is the item ID. And no PLEX page shown. Now I can try typing "plex" all day long and I only get the number.
Yes, this seems to be a new bug that I hit last night on some other items. However, the search worked if I clicked the "go" button and the ItemID only ended up in the search box if I clicked on the "suggestions" list that shows up under the search box as you type stuff in.
Maybe the search box needs to be smart enough to let us search on item ID numbers? :) |

Scrapyard Bob
EVE University Ivy League
692
|
Posted - 2012.02.16 19:38:00 -
[86] - Quote
Steve Ronuken wrote:Anyone else have problems with the unified uploader not picking anything up, after the patch today? (I've restarted the uploader.)
Only if you don't shut down the uploader before patching. Every time the EVE client patches, it moves the old cache directory out of the way and creates a new one.
Also, if you run multiple clients off of multiple junction points, be sure to patch all junction points by starting up a client at least once on each junction point to get the client update for that junction. |

Scrapyard Bob
EVE University Ivy League
694
|
Posted - 2012.02.17 16:54:00 -
[87] - Quote
Various wish lists:
1) Large POS tower fuel cost per 30-days graph. Take the input costs for the (4) fuel block BPOs, assume ME 40, assume Production Efficiency IV, then graph it out based on the historical trade volume from the 4 market hubs. Large towers consume 1 batch (40 blocks) of fuel per hour.
2) Ore value per m3 graph. Show how ISK/m3 has varied over the past few months/years and which ores are at the top of the ISK/m3 pile. Use the refined mineral costs (assuming zero-waste) and base mineral costs off of the hi-sec market hub trade histories.
3) Ice value per block graph. Show the refined value and/or show the block trading price for the different ice types. You may want to divide it up so that there is a hi-sec chart (only the hi-sec ices) and a null/low chart with the fancier ices (it's harder to get good trade values for the null-sec ice).
4) Total traded ISK volume per market hub / system / region over time for the top (8) stations/systems/regions.
|

Scrapyard Bob
EVE University Ivy League
697
|
Posted - 2012.02.18 02:39:00 -
[88] - Quote
Callean Drevus wrote:Quote:4) Total traded ISK volume per market hub / system / region over time for the top (8) stations/systems/regions. I do not think it is possible to do any more than checking this for a region, but it will still be interesting. I had the power to do it for individual orders once (thus also enabling hub/system stats) but I've disabled recording every trade a long time ago. May start it again some time though (still have the function more or less built in).
I envision you just summing up all of the market history information for each region into a "total ISK traded per day" table (primary key: region + date). Then graph the total ISK/day for each of those regions. Offer a 5-day moving average and 20-day moving average variant to smooth out bumps and to more clearly show the rise-and-fall of the various trade regions.
Whether you hand calculate which (4 / 8 / 10) regions to show on the graph would be up to you. |

Scrapyard Bob
EVE University Ivy League
707
|
Posted - 2012.02.22 22:49:00 -
[89] - Quote
The API pages have gone fugly. With the new backgrounds for Parameters / Log Format / etc, it's impossible to read the text without selecting it.
Also, it would be nice if we could link directly to specific API explanation pages instead of saying "go to this URL, then scroll down a lot and look for XYZ".
|

Scrapyard Bob
EVE University Ivy League
749
|
Posted - 2012.03.14 17:55:00 -
[90] - Quote
On the regional prices tab, I'd like to see (2) filters up top.
1) Only show regions with updated prices within the last 6 / 12 / 24 / 48 / 72 hours
2) Only show null or only show empire regions
|
|

Scrapyard Bob
EVE University Ivy League
782
|
Posted - 2012.03.26 03:06:00 -
[91] - Quote
Uploads are not being processed, about an 89k backog at http://www.evemarketeer.com/statistics/uploads |

Scrapyard Bob
EVE University Ivy League
803
|
Posted - 2012.03.30 13:53:00 -
[92] - Quote
Market Scanner page has gotten very unreliable over the past week or two. Sometimes when you hit the "play" button, it does the countdown and starts changing the item displayed, but never opens up the market window in-game.
(I've had to switch to using EMD or EC sites to do the scanning.) |

Scrapyard Bob
EVE University Ivy League
807
|
Posted - 2012.03.30 23:41:00 -
[93] - Quote
Fix it fix it fix it? http://www.youtube.com/watch?v=1Isjgc0oX0s
540k backog now. |

Scrapyard Bob
EVE University Ivy League
817
|
Posted - 2012.04.02 13:29:00 -
[94] - Quote
Thinking about how to calculate the top-10 market hubs again.
The naive method - just sum up all the buy orders value in that location, report on that. Then sum up all the sell order value, report on that. Maybe drop the outliers first.
The 5% method - Take the 5% sell price for each item, multiple by the total number of units for sale. This avoids the "1M ISK shuttle" from skewing the numbers. May as well do the same for the buy price.
Sum of the daily transactions - Use the history data, average the past 7 or 14 days, sum up the amount of ISK that changed hands. But this is only region-wide, not station/system.
Things I would like to see:
- Top market regions by ISK value, both top 10 buy-order regions, top 10 sell-order regions and top 10 combined value.
- Top systems by ISK value (so all of the stations in Jita, not just CNAP 4-4).
- Top stations by ISK value
You should track the top 20 locations in a table each day so you can present the top 5 or top 10 as a graph showing how they stack up over time.
I'm very curious to see how the various regions stack up against each other, and what the top 10 regions / systems are. |

Scrapyard Bob
EVE University Ivy League
819
|
Posted - 2012.04.04 05:37:00 -
[95] - Quote
Speaking of big, slow queries... the Consumer Price Index page takes forever.
http://www.evemarketeer.com/trade/consumerindex |

Scrapyard Bob
EVE University Ivy League
825
|
Posted - 2012.04.05 00:52:00 -
[96] - Quote
So, if I go to this link: http://www.evemarketeer.com/uploader
The "play" button only works about 1/2 the time at getting the market window to open up.
But if I go to: http://www.evemarketeer.com/uploader/display/all/orders
Then it mostly seems to work correctly.
When it breaks, it simply won't open the market window, but the timer sits and cycles through items and counts down. |

Scrapyard Bob
EVE University Ivy League
827
|
Posted - 2012.04.05 13:13:00 -
[97] - Quote
http://www.evemarketeer.com/statistics/uploads
Uploads are backed up again (129k and counting). |

Scrapyard Bob
EVE University Ivy League
835
|
Posted - 2012.04.07 11:44:00 -
[98] - Quote
Callean Drevus wrote:Update: Going to http://www.evemarketeer.com/uploader and clicking play, works for me each and every time. Is there anything specific you are doing before that? I just open the browser and go right to that page then click play. In addition on what machine are you running EVE, and what are it's settings?
Running in 1024x768 minimum setting windowed clients. Alt-B, EMK's market scanner is the home page, click play. It just seems like the countdown timer is a free running bicycle chain which never "catches" to open up the market window. Once it does latch on, it works fine.
EMD's page works flawlessly every time.
My guess, opening up the window causes a EVE API call, and clicking play button too soon might result in a second EVE API call before the 3-second timer resulting in a mute.
|

Scrapyard Bob
EVE University Ivy League
842
|
Posted - 2012.04.09 13:07:00 -
[99] - Quote
Vaerah Vahrokha wrote:Since the other day when the upload stopped working, I am unable to send prices any more. I have cache files delete enabled on startup. It deletes them but won't upload anything, I just see the windows open and close like in the past but nothing gets sent.
Check to see if it lost track of your upload keys. Try clearing cache for each junction point. If you have multiple junction points, make sure you fire up a EVE instance for each junction point (fixes the cache). Restart the uploader.
(The above works for me 99.5% of the time.) |

Scrapyard Bob
EVE University Ivy League
846
|
Posted - 2012.04.10 00:28:00 -
[100] - Quote
Vaerah Vahrokha wrote: If so, what should I manually delete to be sure I don't bork something like i.e. my settings?
Settings files on Win7 are under:
C:\Users\username\AppData\Local\CCP\EVE\c_program_files_(x86)_ccp_eve_tranquility\settings
You should always backup the settings folder regularly.
Cache folders are in the same directory tree and can be freely deleted (if the EVE clients are shutdown).
If you run junctions or multiple clients, then you'll have multiple folders under CCP\EVE, one for each path to the EVE executable. |
|

Scrapyard Bob
EVE University Ivy League
882
|
Posted - 2012.04.19 17:32:00 -
[101] - Quote
Prices are now about 7 days old according to the little green/yellow/orange dots.
http://www.evemarketeer.com/item/group_summary/18
There's also close to 100k in queued uploads. |

Scrapyard Bob
EVE University Ivy League
899
|
Posted - 2012.04.29 21:09:00 -
[102] - Quote
On the unified uploader - If a particular end-point is causing problems (the queue hits 50), then the algorithm should simply skip adding any more items to that end-point's queue until it drops below 50 again. That would probably take care of the issue that if a particular end point is having trouble, the rest of the end points suffer because the upload tool slows down.
Just drop any items which would overflow the queue for that endpoint. If the endpoint is having trouble, to the point that the queue is full, it's probably not going to catch up for a while so no point queuing up additional items. |
|
|
|